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DETAILED ACTION 

1. This commxinication in response to Request for continued prosecution (RCE) filed under 37 CFR 
1. 1 14 and filed 04/14/05, claims 1, 3-23, 25-34, and 37-38 remain pending. 

Claim Rejection under 112 

2. The following is a quotation of the second paragraph of 35 U.S.C. §112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject 
matter, which the applicant regards as his invention. 

3. Claim 1 is rejected vmder 35 U.S.C. 112, second paragraph, as being indefinite for failing to 
particularly point out and distinctly claim the subject matter which applicant regards as the invention. In 
this case, claim 1 recites: '''based on one more modalities'', this raises uncertainties as to whether this one 
more modality is in addition and distinct from the audio and non-audio modality mentioned earlier; 

''serve or present pages to the client in one format compatible with one modality of the clienf\ 
this raises uncertainties as to whether the pages served or presented are the pages requested; 

"one format that is compatible with one modality of the client, wherein the one format comprises 
a multi-modal format that can be rendered in two synchronized modalities'\ this raises uncertainty as to 
whether it is required to be rendered, as best tmderstood, this states that the served or presented page are 
be displayed alternatively in two modalities; 

"two or more synchronized modalities'', this raises uncertainties as to whether these synchronized 
modalities are the same or different than the "plurality of different modalities" discussed earlier in the 
claim; and 

"modalities of the client", this raises uncertainties as to whether the modalities are associated with 
the user according to previous clause "a conversational user interface that enables a client" or a device 
which seems to be what is below argued 

Claim Rejection under 35 U.S.C 

4. Quotation of the appropriate paragraphs of 35 U.S.C. 103 that form the basis for the rejections 
under this section made in this Office action may be found in previous office action. 
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5. Claims 1, 3-23, 27-34, 36-38 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Saylor et al. (US 6,501,832) (Saylor hereafter) in view of Cohen et al. (US 6,859,776) (Cohen hereafter). 

Regarding claim 1, Saylor teaches substantial features of the invention, including 

a ("conversational") browser, which provides a ("conversational") user interface to enable 
access to a ("conversational") portal (12) across a ("plurality of different modalities") two or more multi- 
modal dialog (Saylor: speech-only or text via a phone or Web, respectively see col 4/lines 43-col 5/Hne 
20); 

wherein the conversational browser establishes or support ("adapts") an interaction dialog 
between the conversational portal (12) and a cUent (14) which access the conversational portal over a 
communication network (16) based on one modalities of the chent e.g. audio or visual capability (access 
over the phone or logging via Web see col 4/lines 43-col 5/Kne 8, retrieve voice or visual display of 
requested content see col 5/hnes 9-20, text for visual display see col 8/lines 32-36) ; 

wherein the conversational browser can perform conversational browsing to retrieve one 
information "page" from an information source (70, 18 or 22) in response to a cUent's request and server 
or present the retrieved page to the requesting client in a format that is corrpatible with one modaUties of 
the requesting client by converting the retrieved page, if necessary (col 8/lines 14-63, col 5/lines 4-8, and 
col 5/hnes 9-20, text-speech conversion for client using a phone see col 4/lines 16-28, and col 8/lines 29- 
32); 

said plurahty of modalities including audio (e.g. voice) and non-audio modalities (e.g. text) 
(col 5/lines 9-20, col 8/lines 14-36, and col 12/lines 20-44), although Saylor does not explicitly teach 
information ("page") that can be rendered in two modalities. 

Cohen teaches a page configure with two modalities, specifically, both graphical and voice 
data (col 10/hnes 39-55) or configured with format supporting both voice and data (col 9/lines 32-43), 
associated with a browser configured to rendered respective two modaUties (col 9/lines 10-25). 

It would have been obvious to one ordinary skilled in the art at the time the invention was 
made given the teachings of Saylor configuring portal with voice browser enabling access to cUents 
across two modalities, the teachings of Cohen for enhancing voice browser with dual capabilities 
supporting two modahties voice and visual data, would have been readily apparent Motivation would be 
to configure the browser with gateway capabilities to couple audio voice and conventional Web page 
information enabling user to voice fi-om voice providers and non-voice data from Internet providers, 
enabling access to web pages having two modalities, such as those pages configured with markup 
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languages that support two modalities or pages that can be converted from one modality to another for 
rendering, as suggested by Cohen. 

Regarding claim 3, the information provided by the information sources is inplemented in a multi-modal 
representation, which is a format (Saylor: col 14/lines 46-60, multi-modal content col 23/lines 34-47, col 
4/lines 43 -col 5/line 20). 

Regarding claim 4, confuting device (transcoder), operatively associated with the conversational 
browser, for converting the (multi-modal) information into one specific format (modality-specific format) 
that corresponds to a modality of the requesting client (Saylor: col 23/lines 60-67, col 21/lines 7-41). 

Regarding claim 5, the conversational portal discovers, ascertain, identify (i.e. detects) the modality of the 
requesting client to convert the multi-modal information into the modality-specific format (Saylor: col 
21/lines 7-41, modality of client: col 18/lines 45-col 19/line 11, col 19/lines 46-50, conversion: col 
23/lines 60-67). 

Regarding claim 6, discern (i.e. detects) the modality of the requesting client based on the registration 
protocols (Saylor: registration setup: transactions based on user identified registration, col 8/lines 56-col 
8/line 13, subscribe registration discern modalities of client, col 16/lines 18-col 17/line 4). 

Regarding claim 7, conprising a (portal directory) database (Saylor: 18 of Fig. 1, col 14/lines 19-28), 
accessible by the conversational browser, for storing one of an index of information sources, (Saylor: 
indexed: col 18/lines 13-19, index: col 8/lines 14-36). 

Regarding claim 8, the information is maintained in a (multi-modal) format by a service provider (Saylor: 
70 of Fig. 1, col 11/lines 43-52) of the conversational portal under business agreements between the 
service provider of the conversational portal and service provider of the information sources (Saylor: 
business arrangement: col 34/lines 14-34, business: col 3 8/lines 13-24). 

Regarding claim 9, capturing a connection between the requesting client and the conversational portal and 
maintaining communication link (holding the client captive) during predetermined time periods (Saylor: 
col 26/lines 39-40). 
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Regarding claim 10, a link provided by the conversational browser is selected by the requesting cHent and 
rendered or served to the requesting client (Saylor: voice browser; col 26/lines 41-54). 

Regarding claim 11, the requesting client is released when a link is directly requested by the requesting 
client (Saylor: col 26Aines 39-40). 

Regarding claim 12, a service provider of the conversational portal provides advertisements, during time 
period in which the requesting client is connected (Saylor: col 26/lines 39-40). 

Regarding claim 13, time period between connections established links between different information 
sources (Saylor: col 26/lines 39-40). 

Regarding claim 14, wherein the advertisements and services are multi-modal (Saylor: content: col 2/lines 
5-16, visual or audio content, & multi-modal information col 4/lines 16-28, advertisements: col 9/lines 
54-58, ads; col 36/lines 48-67). 

Regarding claim 15, wherein the advertisements and services are provided by the service provider on 
behalf of a third-party under a business agreement between the service provider of the conversational 
portal and third-party (Saylor: col 36/lines 48-col 37/line, third-party, col 45/lines 65-col 46/line 25). 

Regarding claim 16, for creating audio files or clips (segmenting) and forming structural order of the 
audio files or clips (indexing) audio and multimedia data obtained fi-om an information source (Saylor: 
col 8/lines 14-36 audio or visiial information, indexing multimedia (text, graphics, audio, video) retrieval: 
Saylor: col 8/lines 37-53); and a multimedia database for storing the indexed audio and multimedia data 
(Saylor: col 8/lines 37-53, index database; col 18/lines 13-19). 

Regarding claim 17, retrieving as discussed above, obtains desired segments fi-om the multimedia 
database in response to a client request and presents such segments to the client (Saylor: col 8/lines 14-53, 
index database; col 18/lines 13-19) based on the I/O capabilities of the client (Saylor: col 3/line 63-col 
4/line 4 format that is con5)atible with the I/O modalities of the requesting chent col 8/lines 14-36, 
presented to the user: col 5/lines 4-8, provide to user visual or audio content: col 5/lines 9-20). 
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Regarding claim 18, the conversational browser periodically downloads multimedia data from one 
information soiirce to index and store the multimedia data in the multimedia database (Saylor: col 18/lines 
32-38). 

Regarding claim 19, the downloading and indexing of the multimedia data of the information source is 
performed under a bxisiness agreement between a service provider of the conversational portal and a 
service provider of the information source (Saylor: col 7/lines 4-17). 

Regarding claim 20, subscription program for registering a subscriber (Saylor: col 7/lines 56-col 8/line 
13), a program conprising user-selected multimedia segments in the multimedia database (selection of 
clips see Saylor col 7/lines 32-47, segments col 9/lines 47-58). 

Regarding claim 21, (registered) subscriber can conversationally navigate the program and select desired 
segments for broadcasting via the requesting client (Saylor: col S/lines 9-20). 

Regarding claim 22, however the above-mentioned prior art of record does not teach radio services upon 
request (i.e. upon demand) which the registered subscriber access via a wireless phone (Saylor: wireless 
access protocol device see col 5/lines 9-20, wireless network providers accessed over wireless phones see 
col 5/lines 31-37, over a wireless telephone network see col 10/lines 6-13). 

Regarding claim 23, conprising features discussed on claim 1, same rationale of rejection is applicable 
and further: 

an access device having one modality (Saylor: device supporting one modality: col 9/Unes 59-col 
10/line 5, cHent access device: col 5/lines 9-20 supporting one modality, user device: col 14/lines 10-14); 
a content server (70 of Fig. 1, col U/lines 43-52 or 18 of Fig. 1, col 14/lines 19-28). 

Claim 24 (canceled). 

Regarding claim 25, wherein the multi-modal content pages and applications are in:5)lemented in a 
modality-independent representation (Saylor: col 4/lines 43-59, multi modal, col 14/lines 56-59, multi- 
modal Vpages, col 21/lines 7-41). 
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Regarding claim 26, a voice (conversational) browser for fetching and processing a multi-modal content 
page for presentation to a user based on the I/O capabihties of the access device supporting user selection 
(Saylor: processing for presentation, i.e. rendering see col 26/lines 41-45, fetch col 29/lines 17-28). 

Regarding claim 27, converting one multi-modal content page into one modality-specific representation 
based on detected modality of the access device (Saylor: col 23/lines 60-67, col 21/lines 7-41). 

Regarding claim 28, accessible by the conversational portal, for converting a modality-specific site of a 
content provider into a multi-modal representation (Saylor: the conversational portal discover, ascertain, 
identify (i.e. detects) the I/O modalities of the requesting client to convert the multi-modal information 
into the modahty-specific format col 21/lines 7-41, modality of client: col 18/lines 45-col 19/line 1 1, col 
19/lines 46-50, conversion: col 23/lines 60-67). 

Regarding claim 29, the conversion service is provided by the content provider (Saylor: col 2/lines 21-26, 
59-64) or a third-party under a business agreement with the content provider (Saylor: col 7/lines 4-23). 

Regarding claim 30, an interface (conversational browser) (Saylor: interface col 5/lines 2-8) for 
processing and presenting one of a multi-modal content page and application received by the 
conversational portal (Saylor: col 10/lines 62-64). 

Regarding claim 31, the conversational portal is access by calling a pre-designated telephone nxmiber 
(Saylor: dialing a number, col 6/lines 30-33, connect via telephone, col 25/lines 59-63. 

Regarding claim 32, a listing (directory) of content server addresses (Saylor: col 14/lines 23-32). 

Regarding claim 33, wherein the (portal directory) database conrprises one of multi-modal content pages 
(Saylor: col 14/lines 23-27), associated with one content provider hosted by the conversational portal 
(Saylor: muUi-modal pages associated with provider 70 of Fig. 1, col 1 1/lines 43-52) 

Regarding claim 34, conprising features discussed on claims 1 and 23, same rationale of rejection is 
applicable, and further wherein: access to information is over a commimication network (16 of Fig. 1) 
(Saylor: col 14/lines 14-22); establishing commimication with a conversational portal using an access 
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device (14 of Fig. 1) (Saylor: col 14/lines 1-22, access via communication link, col 5/lines 21-37, 
communication medium, col 1 1/lines 43-52). 

Claim 35 (canceled). 

Regarding claim 36, detecting by the conversational portal at least one modality of the access device (Fig. 
8), and transcoding i.e. converting the retrieved multi-modal information into at least one modality- 
specific format corresponding to the at least one detect modality (Saylor: text-speech conversion for client 
using a phone see col 4/lines 16-28, and col 8/lines 29-32). 

Regarding claim 37, established communication with the user (i.e. holding the user captive) during a 
period in which the retrieving step is executed, presenting one of advertisements (Saylor: col 26/lines 39- 
40). 

Regarding claim 38, provide a broadcast on demand service (Saylor: col 26/lines 39-40). 

Regarding claim 1 rejected under 35 U.S.C. 102(e) as being anticipated by Jamtgaard et. al. (U.S. Patent 
No. 6,430,624) (Jamtgaard hereafter), amendment as filed has overcome this rejection, and it is hereby 
withdrawn. 

Response to Arguments 

6. AppHcant argues (p. 9 of remarks) with respect to claim 1, rejected under 102 over Saylor, that 
the reference does not teach added claim limitation, specifically, a conversational portal that serves or 
presents pages to a client/access device in at least one format that is conpatible with one or more 
modalities of the client/access device, where the at least one format con:5)rises a multi-modal format that 
can be rendered in two or more synchronized modalities. 

In response to the above-mentioned argument that the references fail to show certain features of 
applicant's invention, it is noted that the features upon which applicant relies (i.e., "chent/access device") 
are not recited in the rejected claim(s). Although the claims are interpreted in light of the specification, 
limitations fi-om the specification are not read into the claims. See In re Van Geuns, 988 F.2d 1181, 26 
USPQ2d 1057 (Fed. Cir. 1993). 
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7. Applicant argues (p. 10 of remarks) with respect to claim 1, rejected under Jamtgaard that the 
rejection does not directly address the elements of the claim, the exact language. 

In response to the this argument, it is respectfully noted that it is not the "exact language" 
how the claims are examined, but the claimed terms are given the broadest reasonable 
interpretation inlight of the specification based on the fact that applicant may be his/her own 
lexicographer (MPEP 21 1 1 or 2106). 

8. Applicants arguments with respect to claims 1, 23 and 34 have been considered but are moot in 
view of the new ground(s) of rejection, necessitated by amendment. 

9. Examiner recommends a telephonic interview to accelerate prosecution. 

Citation of Pertinent Art: 

10. The following prior art made of record and not reUed upon are considered pertinent to applicant's 
disclosure. Copies of documents cited Non-patent literature will be provided as set forth in MPEP§ 
707.05(a): 

US 5,889,951 

Teaches a page in at least one format that is con5)atible with one or more modahties of the client, 
wherein the at least one format comprises a multimodal format that can be rendered in to modalities". 
Specifically, hypertext documents or "Web pages" that can be accessed by users via a 'T^rowser" program 
(for exanple, Navigator.™ and Mosaic). When viewed via a browser, a Web page typically displays text 
and color graphics, and can play sound, animation, and video clips. Through the Web, users can access 
the various Intemet services, including Gopher, Telnet, and FTP (colimin 1, lines 21-31). 

5,915,001 

Teaches a gateway system configured with an enhanced browser having voice and web 
capabilities to support users to navigate using both voice and web content. 
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Conclusion 



11. Any inquiry concerning this communication or earlier communications from the examiner should 
be directed to Prieto, B. whose telephone number is (571) 272-3902. The Examiner can normally be 
reached on Monday-Friday from 6:00 to 3:30 p.m If attenpts to reach the examiner by telephone are 
unsuccessfiil, the Examiner's Supervisor, Rupal Dharia can be reached on (571) 272-3880. The fax phone 
number for the organization where this application or proceeding is assigned is (703) 872-9306. Any 
inquiry of a general nature or relating to the status of this apphcation or proceeding should be directed to 
the receptionist whose telephone number is (703) 305-3800/4700. 

Information regarding the status of an apphcation may be obtained from the Patent Application 
Information Retrieval (PAIR) system, status information for published application may be obtained from 
either Private or PubKc PAIR, for unpubUshed application Private PAIR only (see http://pair- 
direct.xispto.^ov or the Electronic Business Center at 866-217-9197 (toll-free). 

Any response to this action should be mailed to: 



Commissioner of Patents and Trademarks 
P.O. Box 1450 
Alexandria, VA 223 13-1450 

or faxed to the Central Fax Office: 

(703) 872-9306, for Official communications and entry; 

Or Telephone: 

703) 306-563 1 for TC 2100 Customer Service Office. 
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